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IV.  SUMMARY  OF  RESEARCH  FINDINGS 


The  entire  research  program  from  September  1978  to  June  1982  was  divided  into 
four  projects,  viz, 

1.  Stochastic  Image  Modeling 

2.  Image  Data  Compression 

3.  Spectral  Estimation  and  Signal  Extrapolation 

4.  Fast  Algorithms 

The  progress  made  in  each  of  these  areas  is  simmarized  below. 

1.  STOCHASTIC  IMAGE  MODELING  PROJECT 

In  1978  [Refs.  A-l ,  A-2,  C-l ,  C-2]  we  introduced  three  canonical  forms 
of  representations  for  two  dimensional  discrete  random  fields.  These 
representations  were  called  causal,  semicausal  and  noncausal.  Our  causal 
models  were  the  same  as  those  studied  earlier  by  other  authors.  However, 
the  semicausal  and  noncausal  models  were  new.  In  our  initial  attempts  it 
was  suggested  that  these  models  could  be  realized  by  considering  stable, 
finite  difference  approximations  of  partial  differential  equations.  Using 
the  concept  of  minimum  variance,  the  spectral  densities  and  prediction 
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properties  of  such  models  could  be  related. 

In  subsequent  developments  [A-6,  C-6,  C-7,  C-8],  the  theory  of  these 
models  was  extended  to  <rbitrary  order  models  without  requiring  their 
origin  in  partial  differential  equations.  This  work  has  led  to  the 
following  results. 

i)  A  method  of  determining  causal,  semicausal  or  noncausal  filters 
which  realize  a  given  spectrum  density  function  or  magnitude  frequency 
response.  This  yields  a  class  of  algorithms  for  spectral  factorization 
of  a  two-dimensional  positive,  analytic  function  ,  u^). 

ii)  The  algorithm  above  yields  irrational  factors,  i.e.,  infinite 
order  models  in  general.  We  have  developed  methods  of  finding  finite 
order  approximations  of  the  factors  such  that,  a)  the  filters  are  stable, 
b)  the  filters  can  match  the  spectral  density  as  closely  as  desired  while 
remaining  finite  order  and  c)  the  filters  converge  uniformly  to  their 
unique,  limit  (irrational  factors)  as  their  orders  go  to  infinity. 

Details  of  these  results  will  appear  in  a  forthcoming  Ph.D.  dissertation 
(see  Ranganath,  E-3)  and  some  related  papers  currently  under  preparation. 

iii)  This  theory,  which  has  now  been  rigorously  established  will  enable 
design  of  algorithms  for  two-dimensional  signal  and  image  processing 
problems  such  as  data  compression,  spectral  estimation,  restoration,  edge 
detection,  etc.  Figs.  1  to  3  show  an  application  of  semicausal  models 
for  developing  an  edge  extraction  algorithm  for  noisy  images.  Comparison 
with  some  of  the  common  edge  extraction  operators  (having  the  same 
computational  complexity)  shows  the  advantage  of  our  technique.  These 
models  have  also  been  found  useful  in  developing  fast  and  effective  filters 
for  image  restoration  problems.  Details  are  discussed  in  [Ref.  C-18] . 


11)  Noiseless  Image  1 v)  Noisy  Image 


Figure  1  :  Original  and  noisy  Images. 


i)  Sobel  operator  edge  detection 
on  noiseless  Image 


111)  Sobel  operator  edge  detection  on 
noisy  Image,  probability  of  error 
Is  about  24% 


11)  Semlcausal  model  operator  edge 
detection  on  noiseless  Image 


1v)  Semlcausal  model  operator  edge 
detection  on  noisy  Image,  proba¬ 
bility  of  error  Is  about  21 


Figure  2  :  An  edge  detection  operator  has  been  developed  using 
a  semlcausal  prediction  model.  This  figure  shows  Its 
performance  on  noiseless  as  well  as  noisy  Images.  Other 
common  operators  such  as  Prewitt,  Isotropic,  etc.  have 
performance  similar  to  or  worse  than  the  Sobel  operator. 


i)  Sobel  operator  edge  detection  111)  Sobel  operator  edge  detection  on 

on  noiseless  Image  noisy  Image,  probability  of  error 

Is  about  24% 


11)  Semlcausal  model  operator  edge  1v)  Semlcausal  model  operator  edge 

detection  on  noiseless  Image  detection  on  noisy  Image,  proba 

blllty  of  error  Is  about  2% 


Figure  j  :  An  edge  detection  operator  has  been  developed  using 
a  semicausa)  prediction  model.  This  figure  shows  Its 
performance  on  noiseless  as  well  as  noisy  Images.  Other 
coninon  operators  such  as  Prewitt,  Isotropic,  etc.  have 
performance  similar  to  or  worse  than  the  Sobel  operator. 


IMAGE  DATA  COMPRESSION  PROJECT 

Results  achieved  in  this  effort  have  appeared  in  [A-5,  A-8,  C-3,  C-4, 

C-5,  C-10,  D-2,  D-3]  and  in  the  dissertations  E-l ,  E-2.  In  particular 
we  have  shown 

1)  The  causal,  semicausal,  and  noncausal  models  developed  in  Image 
Modeling  Project  lead  to  predictive,  hybrid  and  transform  coding 
techniques,  respectively.  Extension  to  noisy  images  and  adaptive 
techniques  is  possible  in  the  framework  of  these  models.  (Refs.  A-5, 

A-6,,  D-3).  One  application  of  these  models  is  the  following  study, 
a)  Image  Coding  by  Stochastic  Decomposition  of  Features 

Here  we  consider  an  image  U  to  be  a  composition  of  two  types  of 
processes  UQ  and  U^,  i.e.» 

u  =  U0  +  Uf 

where  UQ  represents  a  stationary  random  process  in  two  dimensions 
(or  a  random  field)  and  represents  a  deterministic  or  a  nonstationary 
part  of  the  image  called  features .  The  stationary  part  can  be  decomposed 
from  the  other  by  using  the  knowledge  of  the  power  spectrum  of  the 
image.  Specifically,  knowing  the  image  power  spectrum,  we  can  find 
an  operator  L  such  that 

L[U]  ^  e  ^  Eq  + 

where  Eq  is  a  white  noise  process  whose  mean  and  variance  are  known. 

If  the  given  image  were  a  stationary  random  field,  then  e  would  be  Eq. 
However,  due  to  presence  of  nonstationarities  in  the  image  e.g.,  edges 
and  corners,  the  field  e(1,j)  is  a  signal  E^r(i,j)  Immersed  in  a  white  noise 
field  £q(1,J).  Classical  techniques  for  detection  of  signal  (e^)  in  noise 
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(eg)  can  be  employed  to  discriminate  Eq  and  ef  or  equivalently  UQ 
and  U^. 


The  stationary  component  Uq  is  coded  by  (optimum)  transform  coding 

method  and  is  coded  by  a  simple  PCM  combined  with  run-length  coding. 

The  component  is  seen  to  contain  Image  features  such  as  sharp 

*  * 

boundaries,  edges,  etc.  At  the  receiver  the  encoded  images  UQ  and 
are  combined  to  reproduce  the  original  image  as 

*  *  * 

U  =  UQ  +  Uf  . 

*  * 

By  varying  the  allocation  of  bits  between  UQ  and  Uf,  for  a  fixed 

overall  rate,  several  encoded  images  differing  in  visual  quality  are 

* 

obtained.  If  no  bits  are  allocated  to  Uf,  the  technique  reduces  to 
ordinary  transform  coding.  Results  show,  for  a  fixed  signal  to  noise 
ratic  &ased  on  mean  square  error)  and  fixed  average  rate,  encoded 
images  differing  in  visual  quality  can  be  achieved.  In  this  way, 
images  with  higher  visual  quality  than  in  tranform  coding  are  obtained. 
Theoretical  details  and  experimental  results  are  given  in  Ref.  CD-3] . 
b)  Image  Coding  by  Autoregressive  Synthesis 

A  new  method  of  image  data  compression  by  autoregressive  synthesis 
(Refs.  C-3,  C-10)  has  been  developed.  Results  on  line  by  line  image 
coding  show  this  method  is  superior  to  tranform  coding  techniques  (in 
the  visual  sense).  It  is  well  known  that  image  transform  coding 
methods  to  not  perform  well  for  high  contrast  and  facsimile  (printed 
document)  images.  This  AR  Synthesis  method  is  a  universal  transform 
coding  system  which  performs  well  for  monochrome  as  well  as  binary 
images.  This  method  would  be  suitable  for  transform  coding  of  composite 
images  as  well  as  high  resolution  radar  data. 


It  Is  believed  that  these  results  can  be  extended  to  two-dimensional 
data  compression  by  considering  image  synthesis  via  two-dimensional 
semi causal  models  developed  in  the  Image  Modeling  Project. 

This  method  is  based  on  the  physics  of  image  formation  which  suggests 
that  each  line  may  be  considered  as  a  sample  function  of  a  power 
spectrum.  This  formulation  directly  yields  the  autocorrelations  as 
the  coefficients  of  a  Cosine  transform.  An  autoregressive  (AR)  model 
may  then  be  used  to  approximate  the  given  power  spectrum  with  fewer 
coefficients. 

If  a  one-dimensional  object  is  illuminated  by  coherent  or  non-coherent 
light  and  is  imaged  through  a  lens  system,  an  intensity  detector  such 
as  film  will  record 

s(x)  »  |  h(x-5)a(C)d?|  in  the  coherent  case 
or 

s(x)  =  jh2(x-£) |a(0 |2d£  In  the  non-coherent  case 

where  h(x)  represents  the  "impulse  response"  of  the  lens  and  a(x)  the 
object  field  distribution.  In  both  cases,  phase  information  is  lost 
and  s(x)  may  be  regarded  as  a  power  spectrum.  Hence, 

00 

s(x)  *  l  r.  e‘j27rxk  ;  -1/2  <  x  <  1/2 

k=-<=°  * 

will  satisfy  the  usual  properties  of  a  power  spectrum  such  as  positivity 
(implying  a  positive  definite  autocorrelation  sequence  rk)  and  evenness. 
In  the  image  model  we  assume,  each  line  is  regarded  as  a  spectrum  and 


satisfies  these  properties. 

By  appropriate  sampling  of  s(x),  the  autocorrelation  sequence  rk  is 
given  by 

N-l 

rk  ■  2  l  s(m) 

K  m=0 

implying  that  rk  is  the  Cosine  transform  of  the  sampled  image  s(n). 

In  transform  coding  a  zonal  filter  is  applied  to  the  transform  domain 
coefficients  (autocorrelations  in  this  case)  retaining  only  p  coefficients 
(0  <  p  <  N-l)  for  storage  or  transmission. 

In  AR  Synthesis  we  assume  that  the  object  amplitude  distribution  is 
generated  by  an  AR  model : 

a(k)  *  £  a  a(k-m)  +  e(k)  0  <  p  <  N-l 
m=l  m  ~  ~ 

where  {e(k)>  is  a  white  noise  sequence  and 

rR  =  E[a(m)a*(m+k)]  ;  k  e  [-p ,p] 

ak  may  be  obtained  by  solving  the  well  known  "normal  equations" 
using  the  efficient  Levinson  algorithm.  The  ak  may  then  be  coded 
instead  of  the  rk* 

In  conclusion,  the  image  s(x)  synthesized  by  AR  coding  is  continuous 
(filter  Interpolates).  Moreover,  the  AR  model  provides  a  maximum 
entropy  extrapolation  In  transform  domain  (for  1-D  case).  Images 
encoded  by  this  method  show  no  block  effects  and  superior  resolution 


cost"*?)^ 

N 


0  <  k  <  N-l ;  r.  =  r  , 
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compared  to  transform  domain  coding, 
c)  An  Area  Correlation  Method  for  Motion  Estimation 

Area  correlation  and  image  registration  techniques  have  been  developed 
for  measurement  and  analysis  of  motion  using  interframe  image  data. 
Applications  in  image  data  compression  have  been  studied,  (Refs.  A-5, 
A-8). 

The  method  we  developed  is  based  on  an  efficient  algorithm  for  searching 
the  direction  of  displacement  of  an  object  from  successive  frames  of 
image  data.  This  method  requires  a  search  for  the  direction  of  minimum 
(DMD)  between  pixel  neighborhoods  in  successive  frames.  The  distortion 
referred  to  is  the  mean  square  value  of  the  prediction  error.  The 
search  algorithm  converges  logarithmically  (under  the  assumption  of 
local  spatial -stationarity  of  the  image  correlation  statistics).  With 
this  algorithm  we  found  8-10dB  reduction  in  the  prediction  error  which 
led  to  improved  compression  by  a  factor  of  3  to  1.  Details  are  given 
in  Ref.  [A-8]. 


We  have  developed  a  new  technique  for  optimization  of  transform  coding 
in  the  presence  of  channel  errors  or  jamming.  Results  show  the  per¬ 
formance  of  conventional  transform  coding  in  the  presence  of  channel 
errors  can  be  Improved  by  several  dB  in  signal  to  noise  ratio. 

Most  transform  image  coding  techniques  have  been  designed  for  noiseless 
channels.  When  these  coded  Images  are  transmitted  over  a  noisy  channel 
generally  some  error  correcting  codes  are  used  to  reduce  the  probability 
of  channel  errors.  In  many  cases  no  error  correction  Is  done.  An 
obvious  drawback  of  using  traditional  error  correcting  codes  is  that 


they  provide  equal  protection  to  all  the  bits  in  the  code.  However, 
it  is  well  known  that  error  in  different  bits  of  the  code  (which  may 
represent  different  transform  coefficients)  do  not  have  equal  effect 
on  the  quality  of  the  image. 

We  give  the  optimum  solution  to  the  problem  of  bit  assignment  to 
different  transform  coefficients  for  quantization  as  well  as  error 
protection  which  takes  into  account  the  distortions  due  to  channel 
errors  for  the  minimum  mean  square  error  criterion.  Rate  distortion 
curves  as  well  as  actual  experiments  on  images  show  that  by  including 
the  channel  characteristics  in  optimization  of  transform  coding,  large 
gains  are  possible  when  channel  errors  are  present.  Robustness  of  the 
present  approach  to  channel  characteristics  seems  to  be  high.  These 
and  other  related  results  are  given  in  Refs.  [A-5,  D-2]. 

3.  SPECTRAL  ESTIMATION  AND  SIGNAL  EXTRAPOLATION  PROJECT 

Some  new  advances  have  been  made  in  extrapolation  and  spectral  estimation 
of  one  and  two  dimensional  discrete  time/space  signals.  For  one-dimensional 
signals,  we  have  shown  that  several  existing  and  some  new  algorithms  for 
extrapolation  of  discrete  time  bandlimited  signals  arise  when  one  considers 
the  minimum  norm  least  squares  criterion  (MNLS).  The  new  results  are  as 
follows  [Refs.  A-7,  A-6J. 

a)  The  MNLS  problem  can  be  solved  to  obtain  the  extrapolated  estimate 
by  a  gradient  algorithm  with  linear  convergence.  We  show  that  the 
iterative  algorithm  proposed  earlier  by  Papoulis  when  applied  to 
discrete  signals  Is  a  special  case  of  this  gradient  algorithm  and 
converges  to  the  MNLS  solution  of  Ax  *  b. 

b)  It  is  shown  the  convergence  properties  of  the  iterative  extrapolation 


algorithms  can  be  Improved  by  considering  the  steepest  descent  and 
two  step  conjugate  gradient  algorithm. 

c)  It  is  shown  that  the  MNLS  solution  obtained  via  the  singular  value 
decomposition  of  A  gives  rise  to  the  discrete  prolate  spheriodal  wave 
functions  (DPSWF). 

d)  In  the  presence  of  noise  or  clutter,  we  show  that  by  simply  considering 
the  minimum  mean  square  (MNS)  criterion,  one  can  obtain  the  extrapolation 
filter  equations. 

e)  A  recursive  Kalman  filter  type  extrapolation  algorithm  is  easily 
derived  by  using  the  formulation  above. 

For  two-dimensional  data,  we  have  shown  how  the  above  algorithms  could 
be  extended. 

2-Dimensional  Spectral  Estimation 

We  have  also  shown  that  the  stochastic  models  developed  in  the  Image 
Modeling  Project  are  very  useful  in  high  resolution  radar  imaging  applications 
where  spectral  estimation  techniques  are  employed  to  resolve  say,  two  point 
targets  which  are  close  to  each  other.  An  example  of  this  result  is  shown 
in  Figs.  4  and  5.  In  particular,  the  Minimum  Variance  Semi causal  (MV-SC) 
model  yields  a  special  Autoregressive  Moving  Average  (ARMA)  representation 
of  random  fields.  It  is  different  from  the  two-dimensional  so  called 
"causal  filters"  and  is  not  the  maximum  entropy  model  often  cited  in  the 
literature.  However,  it  is  linear  and  is  experimentally  shown  to  perform 
similar  to  or  better  than  the  maximum  entropy  spectral  estimation  methods. 
Experiments  show  the  applicability  of  this  algorithm  to  real  world  spectral 
estimation  problems.  Details  are  given  in  Refs.  [A-6,  C-6,  C-12,  C-15, 

C-16,  E-3]. 
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Application  of  two  dimensional  spectral  estimation  In  high  resolution  target  detection.  There 
are  actually  two  pairs  of  point  targets  present.  In  each  pair  the  targets  are  closely  spaced. 


FAST  ALSORITHMS  PROJECT 

a)  Fast  Simisoidal  Transforms  [Ref.  A-3] 

We  introduced  a  new  family  of  unitary  transforms.  It  is  shown  that 
the  well  known  discrete  Fourier,  Cosine,  Sine  and  the  Karhunen-Loeve 
(for  first  order  stationary  Markov  processes)  transforms  are  members 
of  this  family.  All  the  member  transforms  of  this  family  are  sinusoidal 
sequences  which  are  asymptotically  equivalent.  For  finite  length  data, 
these  transforms  provide  different  approximation  to  the  Karhunen  Loeve 
transform  of  the  said  data.  From  the  theory  of  these  transforms  some 
well  known  facts  about  orthogonal  transforms  are  easily  explained  and 
some  widely  misunderstood  concepts  are  brought  to  light.  For  example, 
the  near-optimal  behavior  of  the  even  discrete  Cosine  transform  to 
the  KL  transform  of  first  order  Markov  processes  is  explained  and, 
at  the  same  time,  it  is  shown  that  this  transform  is  not  always  such 
a  good  (or  near  optimal)  approximation  to  the  above  mentioned  KL 
transform.  It  is  also  shown  that  each  member  of  the  Sinusoidal  family 
is  the  KL  transform  of  a  unique,  first  order,  nonstationary  (in  general) 
Markov  process.  Asymptotic  equivalence  and  other  interesting  properties 
of  these  transforms  can  be  studied  by  analyzing  the  underlying  Markov 
processes . 

b)  Linear  Estimation  via  the  Fast  Fourier  Transform  (FFT) ; 

A  new  fast  non-recurslve  smoothing  algorithm  for  a  linear,  discrete, 
time-invariant  state  variable  system  has  been  developed.  It  is  shown 
that  smoothing  problem  can  be  solved  by  an  FFT  algorithm  without  solving 
the  Riccati  matrix  equation.  Moreover,  the  Rlccati  Matrix  at  several 
Instances  of  time  can  also  be  evaluated  via  the  FFT  approach.  Three 
methods,  including  a  doubling  algorithm,  have  been  developed.  Finally, 


a  block  recursive  filtering  algorithm,  where  data  is  received  and 
smoothed  recursively  block  by  block  is  shown  to  be  achieved  by 
combining  the  above  techniques.  This  algorithm  is  suitable  for  real¬ 
time,  batch  processing  applications  such  as  image  processing  and  array 
processing  of  signals.  Details  are  given  in  Refs.  A-9,  C-9,  C-ll, 

C-14,  D-4. 

Several  of  the  results  described  above  have  been  received  favorably  and 

have  resulted  in  several  invited  papers  and  invited  conference  presentations 

and  invited  conference  session  chairmanships  as  indicated  below. 

Invited  Journal  Papers:  A-5,  A-6 

Invited  Conference  Papers:  C-l ,  C-2,  C-6,  C-8,  C-12,  C-14,  C-15,  C-16, 

C-17 

SUMMARY 

In  summary,  our  research  efforts  have  resulted  in 

i)  9  Journal  Articles  of  which  8  have  been  published  to  date 

ii)  18  conference  papers  and  presentations 

iii)  4  Technical  Reports 

iv)  4  Ph.D's  (2  completed  and  2  in  progress) 

v)  2  M.S.  thesis  (one  completed  and  one  in  progress) 

vi)  One  IEEE  Award;  Dona!  G.  Fink  Prize  to  A.K.  Jain  (to  be  awarded  in  1983). 

Copies  of  papers,  reports  and  other  documents  have  been  submitted  to  ARO 

earlier  and  are,  therefore,  not  included  in  this  report. 
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